Backfitting in Smoothing Spline Anova
نویسندگان
چکیده
A computational scheme for fitting smoothing spline ANOVA models to large data sets with a (near) tensor product design is proposed. Such data sets are common in spatial-temporal analyses. The proposed scheme uses the backfitting algorithm to take advantage of the tensor product design to save both computational memory and time. Several ways to further speed up the backfitting algorithm, such as collapsing component functions and successive over-relaxation, are discussed. An iterative imputation procedure is used to handle the cases of near tensor product designs. An application to a global historical surface air temperature data set, which motivated this work, is used to illustrate the scheme proposed.
منابع مشابه
Nonparametric Decomposition of Time Series Data with Inputs
The backfitting algorithm commonly used in estimating additive models is used to decompose the component shares explained by a set of predictors on a dependent variable in the presence of linear dependencies (multicollinearity) among the predictors. Multicollinearity of independent variables affects the consistency and efficiency of ordinary least squares estimates of the parameters. We propose...
متن کاملEstimation in partially linear models and numerical comparisons
Partially linear models with local kernel regression are popular non-parametric techniques. However, bandwidth selection in the models is a puzzling topic that has been addressed in literature with the use of undersmoothing and regular smoothing. In an attempt to address the strategy of bandwidth selection, we review profile-kernel based and backfitting methods for partially linear models, and ...
متن کاملBayesian hierarchical linear mixed models for additive smoothing splines
Bayesian hierarchical models have been used for smoothing splines, thin-plate splines, and L-splines. In analyzing high dimensional data sets, additive models and backfitting methods are often used. A full Bayesian analysis for such models may include a large number of random effects, many of which are not intuitive, so researchers typically use noninformative improper or nearly improper priors...
متن کاملWavelet estimation of partially linear models
A wavelet approach is presented for estimating a partially linear model (PLM). We find an estimator of the PLM by minimizing the square of the l2 norm of the residual vector with penalizing the l1 norm of the wavelet coefficients of the nonparametric component. This approach, an extension of the wavelet approach for nonparametric regression problems, avoids the restrictive smoothness requiremen...
متن کاملUsing recursive algorithms for the efficient identification of smoothing spline ANOVA models
In this paper we present a unified discussion of different approaches to the identification of smoothing spline analysis of variance (ANOVA) models: (i) the “classical” approach (in the line of Wahba in Spline Models for Observational Data, 1990; Gu in Smoothing Spline ANOVA Models, 2002; Storlie et al. in Stat. Sin., 2011) and (ii) the State-Dependent Regression (SDR) approach of Young in Nonl...
متن کامل